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1.  INTRODUCTION 


Satellite-based  navigation  systems  and  a  new  generation  of  microprocessor-based  cockpit 
avionics  are  revolutionizing  air  traffic  control  worldwide.  In  the  United  States,  many  transport 
and  military  aircraft  are  now  equipped  with  global  positioning  system  (GPS)  based  area 
navigation  (RNAV)  computers  or  flight  management  systems,  which  are  used  for  supplementary 
en  route  and  oceanic  navigation.  Research  is  underway  to  develop  differential  GPS  systems  with 
the  horizontal  and  vertical  accuracy  and  integrity  needed  for  precision  instrument  approaches  so 
that  aging  VOR  and  ILS  navaids  can  be  phased  out.  Meanwhile,  the  horizontal  accuracy  of 
ordinary  non-differential  GPS  receivers  (100  m)  is  sufficiently  good  that  the  Federal  Aviation 
Administration  (FAA)  encourages  their  use  for  less  demanding  non-precision  approaches, 
employing  conventional  altimetry  for  descent.  Pilots  are  now  permitted  to  fly  most  existing 
non-precision  approaches  using  GPS  as  the  primary  reference.  The  FAA  has  also  begun  to 
certify  new  approaches  specifically  designed  for  GPS-equipped  aircraft.  This  initiative  is 
particularly  important  for  the  general  aviation  (GA)  community,  since  non-precision  approaches 
to  thousands  of  new  airports  will  eventually  be  possible.  Because  GPS  approach  waypoints  can 
be  arbitrarily  positioned,  non-traditional  approach  geometries  can  be  employed  to  improve 
obstacle  clearance,  or  reduce  noise  and  air  traffic  congestion.  GPS  RNAVs  have  flexible 
electronic  displays,  updateable  databases,  and  many  more  operating  modes  than  traditional  VOR, 
DME,  ILS,  and  ADF  equipment.  The  new  RNAVs  can  potentially  make  instrument  flying  both 
easier  and  safer,  provided  that  the  human  factors  aspects  have  been  properly  considered  at  the 
design  stage. 

GPS  navigators  for  civil  aircraft  must  meet  minimum  performance  and  display  airworthiness 
standards  established  by  the  FAA  (TSO  C-129,  and  RTCA/DO-208).  Approved  units  are  now 
available  from  some  manufacturers.  In  most  GA  aircraft,  instruments  are  of  the  traditional 
“round  dial”  type,  and  panel  space  is  limited.  Hence,  GPS  navigators  are  typically  stand-alone 
devices  which  occupy  a  radio  or  instrument  slot.  Only  a  small  LCD  or  CRT  display  and  a 
limited  set  of  control  buttons  and  knobs  are  practical.  Since  the  GPS  cross  track  error  (XTE) 
information  functionally  replaces  that  from  VOR,  XTE  is  typically  converted  to  an  analog  signal, 
and  displayed  on  an  existing  VOR  or  ILS  course  deviation  indicator  (CDI),  or  Horizontal 
Situation  Indicator  (HSI)  needle,  as  shown  in  Figure  1.  Alternatively,  a  simulated  CDI  needle 
can  be  displayed  on  the  navigation  receiver  itself  (Figure  2).  As  with  VOR-driven  CDIs,  the 
pilot  always  flies  “toward”  the  needle  to  center  it,  but  needle  sensitivity  is  in  linear,  rather  than 
angular  units,  and  is  scheduled:  ±  5  nm  full  scale  while  en  route,  increasing  to  1  mile  during 
initial  approach,  to  0.3  miles  2  miles  before  final  approach,  and  returning  to  1  mile  if  a  missed 
approach  is  flown. 
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XTE  needle 
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Figure  1.  (Top)  Analog  XTE  on  Horizontal  Situation  Indicator  CDI.  (Bottom) 
Alphanumeric  data  as  they  might  appear  on  nearby  GPS  receiver  display 
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Figure  2.  Analog  XTE  CDI  on  GPS  Receiver  Display 


Maintaining  an  aircraft  on  course  centerline  using  XTE  information  is  a  demanding  manual 
control  task.  The  pilot’s  stick  position  determines  the  third  derivative  of  XTE.  Human  operators 
cannot  stably  control  so-called  “triple  integral”  dynamics  by  monitoring  XTE  alone.  Pilots  must 
monitor  roll  attitude  and  heading,  and  in  a  crosswind,  use  a  cut-and-try  technique  to  determine 
the  proper  wind  correction  angle.  To  avoid  large  oscillations  across  the  course  centerline, 
particularly  during  the  critical  stages  of  the  final  approach,  pilots  must  partially  base  their 
control  on  the  rate  of  change  of  XTE.  In  the  parlance  of  manual  control,  this  is  called  “outer  loop 
lead.”  If  XTE  needle  sensitivity  is  low,  the  rate  of  movement  of  the  XTE  needle  is  not  easily 
perceived,  especially  since  the  pilot  must  frequently  look  to  monitor  other  attitude,  heading, 
airspeed  and  altitude  instruments.  On  final  approach,  XTE  needle  sensitivity  is  deliberately 
increased  to  help  the  pilot  see  its  movement  and  null  small  errors.  However,  when  CDI 
sensitivity  is  high,  the  pilot  must  more  frequently  scan  all  instruments,  reducing  the  time 
available  to  perform  other  tasks,  and  increasing  workload.  The  pilot’s  ability  to  create  outer  loop 
lead  is  determined  by  instrument  scanning  delay  (Clement  et  al.,  1968).  Any  side  task  which 
delays  instrument  scan  impairs  tracking  performance.  In-flight  studies  have  demonstrated  a  direct 
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relationship  between  CDI  sensitivity  and  pilot  workload,  and  an  inverse  relationship  with  XTE 
during  non-precision  approaches  (Huntley  et  al.,  1991)  . 

The  capability  of  GPS  RNAV  systems  to  determine  the  direction  of  the  aircraft’s  ground  track 
with  only  a  brief  delay  is  potentially  of  importance  for  aircraft  manual  control.  Since  the  desired 
heading  is  known,  it  is  possible  to  compute  “track  angle  error”  (TAE),  the  difference  between  the 
desired  track  and  the  actual  track.  As  shown  in  Figure  3,  TAE  is  mathematically  proportional  to 
the  rate  of  change  of  XTE,  the  important  manual  control  variable.  If  TAE  were  displayed  to  the 
pilot,  the  pilot  would  not  have  to  try  to  judge  the  rate  of  movement  of  the  XTE  needle.  XTE 
could  be  less  frequently  scanned,  and  the  pilot’s  performance  might  improve.  There  are  several 
ways  TAE  information  could  be  presented.  One  indirect  method  is  to  use  TAE  information  to 
derive  an  inner  loop  attitude  command.  However,  many  GA  aircraft  lack  the  necessary  flight 
director  equipped  attitude  indicator.  A  second  indirect  method  is  to  derive  a  TAE  based  “course 
to  steer”  —  a  heading  flight  director.  However,  this  ideally  requires  an  additional  indicator  on 
the  primary  heading  display  not  available  on  existing  instruments.  Another  option  is  to  use  TAE 
to  estimate  future  XTE  —  a  “predictor  XTE”  display.  However,  information  on  present  XTE 
must  also  be  presented,  and  specific  information  on  the  magnitude  of  the  intercept  angle  may 
also  be  of  interest  to  the  pilot.  A  fourth  alternative  is  simply  to  directly  present  TAE  information 
on  the  GPS  RNAV  itself  in  analog  form.  It  makes  sense  that  if  TAE  were  explicitly  displayed, 
pilots  might  learn  to  take  advantage  of  it. 


Figure  3.  The  derivative  of  Cross  Track  Error  (XTE)  is  Proportional  to  Track 

Angle  Error  (TAE) 

TSOed  GPS  RNAVs  are  required  to  have  at  least  a  numeric  display  of  TAE.  TSO  C-129 
suggests  that  “the  use  of  non-numeric  XTE  data  integrated  with  non-numeric  TAE  data  into  one 
display  may  provide  the  optimum  of  situation  and  control  information  for  the  best  overall 
tracking  performance.”  However,  the  TSO  does  not  specify  the  graphical  format  of  these 
displays,  in  part  because  pilot  performance  with  analog  TAE  displays  has  never  been  formally 
investigated.  The  goal  of  this  research  was  to  begin  this  process  via  simulator  experiments. 

The  purpose  of  this  simulator  research  project  was  to  see  how  pilots  used  explicit  TAE 
information  when  it  was  presented  numerically  and  also  in  analog  form  in  several  different 
formats.  Which  format  do  pilots  favor,  and  why?  To  what  extent  does  the  addition  of  TAE 
information  allow  pilots  to  quantitatively  improve  their  approach  performance,  or  reduce  their 
workload? 
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2.  METHODS 


2.1  DISPLAYS 

The  TAE  GPS  receiver  display  formats  were  evaluated  in  experiments  performed  using  a 
modified,  fixed  base,  light  twin  engine  flight  simulator  (Frasca  International,  Inc.  Urbana,  IL, 
Model  242).  A  network  of  additional  computers  performed  the  GPS  navigation  calculations, 
created  the  displays  and  altitude  dependent  wind,  and  collected  data.  The  display  formats 
evaluated  were: 

1 )  Separate  TAE  and  XTE  sliding  pointer  displays  (2  versions).  This  format,'  shown  in  Figure  4 
(top)  added  a  TAE  sliding  pointer  display  beneath  a  conventional  “fly  to”  XTE  GDI.  The  TAE 
pointer  was  a  triangle,  located  just  beneath  the  XTE  needle,  and  using  the  same  “ten  dot”  (1.5- 
inch,  123-pixel-wide)  scale.  When  the  triangle  was  centered,  TAE  was  zero.  Full-scale  TAE 
triangle  deflection  was  set  at  ±  90  degrees,  since  this  is  the  maximum  useful  course  intercept 
angle.  Which  way  should  the  TAE  triangle  move  in  response  to  a  roll  command?  One 
alternative  is  to  have  the  triangle  move  in  the  same  direction  as  the  stick  roll  command.  This  is 
easy  to  remember,  and  has  the  advantage  that  both  the  needle  and  the  triangle  appear  on  the  same 
side  of  the  display  when  converging  with  course.  This  version  was  therefore  referred  to  as 
“Triangle/Same.”  However,  a  concern  was  that  this  makes  the  TAE  triangle  a  “fly  from” 
display.  Since  the  XTE  display  above  it  is  “fly  to,”  this  version  apparently  violates  the  well 
known  human  factors  “command-response  consistency”  guideline.  A  second  version  of  this 
format  was  also  evaluated,  where  the  sign  of  the  triangle  movement  was  reversed.  This  version 
was  referred  to  as  “Triangle/Opposite,”  and  is  shown  in  Figure  4  (middle). 

2)  A  TAE/XTE  sliding/rotating  pointer  integrated  display.  In  this  format,  shown  in  Figure  4 
(bottom),  the  needle  was  replaced  with  an  (0.6-inch,  50-pixel-long)  arrow,  whose  horizontal 
position  was  proportional  to  XTE  and  tilt  angle  was  equal  to  TAE.  This  way,  dimensional 
correspondence  was  preserved  for  the  linear  and  angular  variables.  The  sign  of  the  arrow 
rotation  was  chosen  so  it  always  moved  horizontally  in  direction  of  its  tilt.  In  practice,  the 
display  resembled  a  “mail  slot  view”  of  a  track  up  moving  map  display,  where  the  arrow 
corresponded  to  the  desired  track,  and  the  GDI  scale  to  a  downward-looking  view  of  the 
aircraft’s  wings.  If  the  pilot  adopted  this  “inside  out,”  aircraft  centered  frame  of  reference, 
interpretation  of  this  display  was  very  intuitive.  This  format  was  referred  to  as  the  “Track 
Vector”  display. 

To  assess  the  value  of  explicit  TAE  information,  these  three  displays  were  experimentally 
compared  to  an  “XTE-only”  receiver  display,  shown  in  Figure  2.  All  four  formats  required  the 
pilot  to  frequently  look  over  to  the  GPS  receiver  for  XTE/TAE  information,  so  a  fifth  format  was 
also  included,  in  which  XTE  was  presented  along  with  heading  information  on  an  HSI,  and  only 


Originally  suggested  by  G.  Lyddane,  an  FAA  pilot,  National  Resource  Specialist  for  Flight  Management  Systems,  and  an 
author  ofTSO  C-129. 
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Figure  4.  Three  GPS  TAE  Display  Formats  Studied.  Top:  Triangle/Same;  Middle: 
Triangle/Opposite:  Bottom:  Track  Vector 


alphanumeric  information  was  presented  on  the  receiver,  as  shown  in  Figure  1 .  The  HSI  was  70 
cm  from  the  pilot’s  eye,  and  9.5  cm  beneath  the  attitude  indicator.  The  GPS  receiver  display  was 
created  on  a  high  resolution  LCD  display,  located  35  cm  (27  deg)  to  the  right  of  the  HSI,  in  a  2 
in.  by  4  in.  area  subtending  approximately  10  deg  of  horizontal  visual  angle.  A  consistent  set  of 
generic  alphanumeric  data  was  presented  on  all  5  displays:  last  and  next  waypoint,  desired  track 
(DTK),  numeric  XTE,  groundspeed  (GS),  and  distance  (DIST)  to  waypoint.  Numeric  TAE  was 
shown  only  on  TAE  displays.  In  all  approaches,  the  pilot  had  to  monitor  DIST,  and  if  a  turn  at 
the  next  waypoint  was  required,  initiate  a  standard  (3  deg/sec)  turn  at  the  appropriate  point  to 
intercept  the  next  leg.  Waypoints  automatically  sequenced  when  the  aircraft  crossed  a  line 
bisecting  the  angle  between  die  inbound  and  outbound  legs. 

2.2  SUBJECTS ,  SESSIONS,  AND  EXPERIMENT  DESIGN 

Six  multi-engine,  instrument  rated  pilots  were  recruited  locally.  Total  flight  time  averaged  1967 
hr  (range  750-3387  hr),  and  included  an  average  of  73  hr  (10-213  hr)  actual  instrument,  125  hr 
(30-370  hr)  of  simulated  instrument,  and  78  hr  (4-240  hr)  of  time  in  various  simulators.  Multi- 
engine  experience  averaged  498  hr  (22-1500  hr).  They  had  flown  an  average  of  four  (0-14) 
approaches  and  26  hr  (0-82  hr)  in  the  past  month,  and  an  average  of  6.3  hr  (0-28  hr)  in  the  week 
preceding  the  experiment. 
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Each  pilot  flew  a  total  of  20  approaches,  four  with  each  of  the  five  display  formats,  and  two 
different  types  of  approach  geometries.  Each  approach  required  about  15  minutes,  so  the 
experiment  was  conducted  in  two  ten-approach  sessions  on  separate  days.  Pilots  were  given  a 
written  and  oral  briefing  on  the  displays  and  the  experiment  procedures.  Each  day  they  flew  the 
simulator  and  practiced  with  the  displays  until  they  felt  familiar  with  them.  They  then  flew  3-4 
complete  practice  approaches  with  the  different  displays  to  asymptote  practice  effects,  and  then 
flew  10  test  approaches.  To  minimize  confusion  between  the  two  triangle  formats,  pilots  flew 
with  only  one  of  the  triangle  formats  each  day.  Half  the  subjects  flew  with  the  triangle/same 
first.  The  presentation  order  of  triangle  displays  was  thus  blocked,  but  for  the  three  other  formats 
was  randomized  and  balanced  within  sessions.  The  order  was  the  same  for  all  pilots. 


2.3  AIRCRAFT,  TURBULENCE,  WIND  SIMULATION,  AND  GPS  APPROACH 
GEOMETRIES 

Aircraft  dynamics  resembling  a  Piper  Aztec  were  simulated  via  computer  (Frasca  242  X4X-386 
Flight  System  Model  VI.  11).  To  perturb  the  flight  path,  non-Gaussian,  patchy  turbulence 
(Jansen,  1981)  was  added  about  the  three  aircraft  attitude  axes.  The  disturbances  qualitatively 
resembled  moderate-severe  turbulence,  and  required  the  pilot  to  closely  monitor  the  attitude 
indicator  to  maintain  control.  Wind  was  always  a  45  deg  left  or  right  head  wind  with  respect  to 
the  final  approach  heading,  but  strength  varied  from  35  kt  at  3100  ft  above  ground  to  15  kt  at  the 
surface,  using  a  power  law  atmospheric  model.  On  many  legs,  up  to  14  deg  of  heading 
correction  was  required.  Pilots  knew  the  wind  direction  varied,  but  were  not  told  that  only  two 
relative  wind  directions  were  used. 

Eight  approach  charts  were  employed.  Each  approach  had  a  different  final  approach  heading  and 
required  altitude,  so  that  pilots  could  not  memorize  the  numbers.  Half  the  charts  used  a  GPS  “T’ 
geometry,  as  shown  in  the  Figure  5  example.  The  aircraft  was  initialized  0.5  nm  upwind  and 
abeam  of  the  initial  approach  fix  (lAF),  located  at  one  end  of  the  top  of  the  T.  The  pilot  was 
required  to  intercept  the  initial  approach  leg,  and  fly  5  miles  to  an  intermediate  approach 
waypoint  (IF)  at  the  center  of  the  “T,”  maintaining  3100  ft  above  ground  level  (AGL).  At  the  IF, 
the  pilot  was  instructed  to  turn  90  deg,  and  fly  5  miles  to  the  final  approach  fix  (FAF).  A 
waypoint  2  miles  before  the  FAF  showed  where  XTE  GDI  sensitivity  changed  from  ±1  nm  to 
±0.3  nm.  The  pilot  was  to  lower  the  flaps  and  landing  gear  just  before  the  FAF  and,  after  passing 
it,  fly  5  miles  to  the  missed  approach  point  (MAP)  while  descending  to  the  750  ft  minimum 
descent  altitude  (MDA).  At  the  MAP,  the  pilot  was  to  retract  gear  and  flaps,  and  climb  back  to 
3100  ft  AGL,  flying  to  a  first  missed  approach  fix  5  miles  directly  ahead,  make  a  second  90 
degree,  level  turn,  and  then  fly  5  more  miles  to  a  missed  approach  holding  fix  (MAHF).  (Each 
chart  had  2  or  more  lAFs,  but  the  one  used  was  always  on  the  same  side  of  the  runway  as  the 
MAHF,  so  all  turns  were  made  in  the  same  direction  on  any  given  run.)  The  turns  permitted  us  to 
study  performance  while  intercepting  the  subsequent  leg.  The  initial,  intermediate,  and  second 
miss  legs  were  flown  at  constant  altitude,  and  provided  opportunities  to  measure  tracking 
performance. 


7 


Figure  5.  Example  of  the  NOS-Style  GPS  "T"  Approach  Charts  Used.  Top:  plan  view. 
Bottom:  elevation  view,  minima,  and  fictitious  airport  diagram 

The  remaining  approaches  used  a  “Crooked  T”  geometry^  which  required  the  pilot  to  also  make  a 
45  deg  turn  while  initiating  descent  at  the  FAF,  and  then  fly  a  2  mile  descending  dogleg  before 
turning  back  to  the  runway  heading.  There  was  a  minimum  crossing  altitude  at  the  dogleg 
waypoint.  Since  these  were  descending  turns  made  with  0.3  nm  CDI  sensitivity,  the  Crooked  T 
approaches  were  expected  to  be  much  more  difficult  to  fly. 

During  the  approach  and  missed  approach  pilots  were  required  to  perform  the  usual  checklist 
items,  such  as  turning  on  and  off  fuel  pumps  and  tuning  the  radio  to  a  frequency  found  on  the 
chart  and  announcing  their  position.  All  pilots  were  instructed  to  fly  the  approach  and  the  missed 


^  The  ‘X’  approaches  resembled  an  approved  GPS  approach  at  Oshkosh,  WI.  The  “Crooked  T’  geometry  was  hypothetical,  and 
chosen  so  that  the  pilot’s  ability  to  reintercept  the  final  approach  course  after  a  maneuver  could  be  evaluated. 


approach  at  120±10  kts,  to  fly  as  close  to  course  centerline  as  possible,  to  maintain  altitudes 
within  100  ft,  but  never  to  descend  below  the  MDA. 


2.4  WORKLOAD,  DISPLAY  PREFERENCE  AND  APPROACH  PERFORMANCE 
METRICS 

Immediately  after  each  approach,  pilots  were  asked  to  rate  the  overall  workload  on  a  10  point 
modified  Bedford  workload  scale,  which  emphasized  spare  attention  (Roscoe  and  Ellis,  1990; 
Huntley  et  al.,  1993).  They  were  asked  to  describe  any  errors  made,  and  then  to  rank  in  order  the 
six  legs  of  the  approach  from  easiest  to  hardest.  After  the  second  test  session,  a  questionnaire 
was  administered  which  required  the  pilots  to  subjectively  rank  the  five  displays  using  several 
different  display  preference  scales.  These  included  ease  of  interpretation  (EOI),  effect  on  flight 
path  control  accuracy  (FPA),  and  overall  preference  (OP).  In  addition,  each  pilot  was  asked  to 
indicate  relative  preference  between  individual  pairs  of  displays  on  a  ±  7  point  scale.  The  scores 
from  these  10  pairs  were  summed  using  a  tournament  method,  and  ranked  by  display,  to  yield  a 
second  measure  of  overall  preference  based  on  direct  “head-to-head”  (HTH)  comparisons. 

Aircraft  position  and  six  performance  parameters  (XTE,  TAE,  altitude,  airspeed,  pitch  and  roll 
attitude)  were  sampled  continuously  at  approximately  1  Hz  by  computer.  Ground  tracks  from 
each  of  the  120  approaches  were  “normalized”  (rotated  to  a  common  southerly  final  approaeh 
heading,  east/west  reversed  where  appropriate)  and  compared  by  display.  The  combined  traek 
records  were  used  to  retrospectively  separate  the  approach  into  a  series  of  13  segments  of  varying 
lengths,  ehosen  to  isolate  the  various  intercept,  tracking,  turning,  descending  and  climbing 
phases  of  the  approach.  For  purposes  of  comparison  between  display  formats  and  pilots,  the 
mean,  standard  deviation,  and  RMS  values  of  all  six  performance  parameters  listed  above  were 
computed  longitudinally  along  13  different  approach  segments  and  analyzed  using  Systat  v.5.2 
(Systat,  Inc.,  Evanston,  IL).  In  addition,  for  each  approach,  XTE  was  sampled  at  half  mile 
intervals  along  the  desired  track.  XTE  deviations  on  the  same  side  of  the  desired  track  as  the 
approach  initiation  point  were  taken  as  positive.  At  each  successive  location,  samples  were 
averaged  by  display  format,  and  the  mean  and  95%  limits  of  the  XTE  distribution  were  estimated 
for  each  slice  along  the  desired  track.^  Differences  in  tracking  performance,  as  measured  by  the 
variance  of  XTE  for  different  pairs  of  displays  were  assessed  based  on  their  F  ratio. 

Note  that  in  this  simulation,  various  GPS  system  errors  —  including  the  deliberate  random  error 
introduced  by  the  US  Department  of  Defense’s  “Selective  Availability”  procedure  —  were  not 
simulated.  Hence,  XTE  provides  a  direct  measure  of  “Flight  Technical  Error”  (FTE),  the 
discrepancy  between  the  desired  and  actual  position  of  the  aircraft  as  displayed  to  the  pilot. 


The  95%  limits  of  XTE  were  estimated  based  on  a  method  originally  proposed  by  Huntley  (1993);  The  mean  (M)  and  sample 
standard  deviation  (S)  of  XTE  at  each  successive  0.5  nm  location  (“slice”)  were  computed,  ehsemble  averaging  across  all 

approaches  of  the  same  type.  Assuming  XTE  is  normally  distributed  with  a  variance  o^,  then  (S/a)  is  distributed  as  (x^/(n-  I  ))“■’. 
If  L  is  the  tabulated  p-0.025  value  for  x^/(n- 1 ),  then  the  95%  upper  confidence  limits  of  XTE  can  be  estimated  to  be 
M  ±  1.96*L“*S. 
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3.  RESULTS 


3.1  PILOT  DISPLAY  EVALUATIONS 

In  debriefing  evaluations,  pilots  noted  that  TAE  displays  had  the  following  advantages  over  the 
XTE-only  formats: 

a)  When  intercepting  a  new  leg,  pilots  could  choose  an  appropriate  intercept  TAE  and  then 
reduce  it  in  several  steps  as  they  approached  course  centerline,  to  avoid  overshooting. 

b)  While  tracking  along  a  leg,  an  offset  of  the  triangle  or  a  tilt  of  the  vector  allowed  pilots  to 
detect  and  anticipate  the  magnitude  and  direction  of  slow  changes  in  XTE. 

c)  Pilots  found  that  they  could  distinguish  the  “diverging”  and  “converging”  XTE/TAE  pointer 
configurations  at  a  glance  and  react  appropriately.  For  example,  when  the  triangle/same  pointers 
were  on  opposite  sides  of  center,  or  when  the  track  vector  was  tilted  away  from  center,  correetive 
action  was  immediately  needed. 

d)  When  tracking,  it  was  possible  to  immediately  determine  the  crosswind  correction  angle 
without  using  trial  and  error.  Pilots  noted  the  heading  when  TAE  equaled  zero  and  many  chose 
to  set  the  heading  indicator  “bug”  to  this  value,  and  simply  made  small  left-right  course 
corrections  by  flying  one  side  of  the  bug.  While  training,  pilots  found  it  was  possible  to  adopt  a 
loop  separation  control  strategy,  using  bank  angle  to  control  TAE  and  then  TAE  to  control  XTE, 
while  largely  ignoring  heading.  However,  closed  loop  control  of  the  TAE  pointer  required 
frequent  scan  of  the  TAE  display.  Most  pilots  found  this  difficult  or  inappropriate  to  do  in 
turbulence,  because  the  attitude  indicators  required  so  much  attention,  and  instead  relied  on 
familiar  attitude  and  heading  control  strategies,  using  TAE  to  command  an  appropriate  heading. 

e)  If  the  XTE  indicator  was  off  scale,  an  appropriate  indication  on  the  TAE  pointer  reassured  the 
pilot  that  XTE  would  soon  be  on  scale  again. 

The  following  TAE  display  deficiencies  were  noted: 

1)  Three  pilots  reported  they  occasionally  had  difficulty  interpreting  the  track  vector  display. 
There  appeared  to  be  two  reasons  for  this.  The  first  was  that  the  format  resembled  a 
conventional  GDI,  not  a  moving  map  display,  and  there  was  no  explicit  aircraft  symbol  in  the 
center.  Several  pilots  said  they  had  “difficulty  remembering  which  was  the  airplane  and  which 
was  the  track.”  The  second  was  that  the  vector  would  suddenly  “flip”  by  90  deg  during  turns  as 
the  aircraft  crossed  the  turn  bisector.  The  pilot  needed  to  mentally  rotate  the  desired  track 
reference  frame  in  order  to  maintain  the  “inside  out”  map  interpretation.  Several  pilots  found 
they  could  not  consistently  do  this. 

2)  Several  pilots  felt  that  small  TAE  offsets  were  more  easily  detected  using  either  of  the 
triangle  displays  than  the  vector  display.  In  fact  the  graphical  resolution  of  the  track  vector 
display  was  slightly  better  than  the  triangle  displays  (1.2  deg  vs.  1.5  deg),  but  the  track  vector 
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pointer  showed  staircasing  (aliasing)  when  it  was  nearly  vertical,  and  there  was  no  vertical 
reference  mark. 

It  seems  likely  the  track  vector  display  could  be  improved  by  adding  a  fixed,  central  aircraft 
reference  symbol  and  a  surrounding  outline  box  to  promote  the  map  interpretation,  and  a  vertical 
reference  mark  to  permit  vernier  judgments  of  tilt. 

3.2  PILOT  DISPLAY  PREFERENCES 

Post-session  questionnaire  data  indicated  a  general  preference  for  the  triangle/same  display  over 
either  of  the  other  two  TAE  displays.  At  the  same  time,  the  rankings  underscored  the  relative 
importance  to  the  pilots  of  having  XTE  information  in  the  primary  instrument  scan  area,  rather 
than  alone  on  the  GPS  receiver.  Results  are  shown  in  Table  1.  A  statistically  significant  effect 
of  display  was  found  for  the  HTH,  FPA,  and  EOI  scale  rank  scores  from  the  individual  subjects 
(Friedman  rank  ANOVAs,  p  <  0.04).  For  the  OP  scale  results,  the  display  effect  was  at  the  p  < 
0.06  level. 

Table  1.  Pilot  Display  Preference  Ranks  by  Display,  Using  Four  Different  Scales  (see  text). 

Rank  =  1  is  best. 


Display  Display  Preference  Scales 

Format  OP  HTH  FPA  EOI 


A/Same 

2 

2 

1 

2 

A/Opposite 

3 

4 

2 

5 

Vector 

4 

3 

4 

3 

HSI 

1 

1 

3 

1 

XTE  only 

5 

5 

5 

4 

On  the  Overall  Preference  (OP)  and  Head-To-Head  (HTH)  comparison  scales,  pilots  consistently 
preferred  the  HSI  display  over  the  “triangle/same”  TAE  display.  However,  in  terms  of  summed 
rank  scores,  the  margin  was  slight.  When  asked  to  make  head-to-head  comparisons,  half  the 
pilots  preferred  the  triangle/same  display,  two  preferred  the  HSI  display,  and  one  judged  it  a  tie. 
Directly  comparing  the  “triangle/same”  and  “triangle/opposite”  versions,  four  pilots  preferred  the 
former,  and  only  one  pilot  preferred  the  latter.  All  pilots  always  ranked  one  or  more  of  the  TAE 
display  formats  above  the  XTE-only  on  both  scales,  so  the  consensus  was  clear  that  TAE 
information  was  subjectively  useful. 

For  accurate  flight  path  control,  pilots  preferred  the  triangle/same  display,  though  the  three 
subjects  (1,  4,  and  5)  who  actually  tracked  most  consistently  ranked  the  HSI  first  in  this  respect. 
Four  of  the  five  pilots  said  the  HSI  was  the  easiest  of  the  displays  to  interpret,  though  three  of  the 
four  cited  long-standing  training  and  experience  with  the  HSI  format  as  one  reason  for  this 
preference. 
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Four  of  the  six  pilots  said  they  never  referred  to  the  numeric  TAB  information  at  all,  since  it  was 
not  obvious  how  to  interpret  the  L/R  TAB  indication,  and  because  the  analog  TAB  pointer  was 
available. 


3.3  INFLUENCES  ON  SUBJECTIVE  WORKLOAD 

Average  Bedford  subjective  workload  was  3.5  out  of  10  on  T  approaches,  and  increased  to  4.5  on 
Crooked  T.  Subject  2  had  the  highest  average  workload  (6.2)  and  Subject  1  the  lowest  (3.0). 
ANOVA  of  modified  Bedford  Workload  scores  revealed  significant  effects  between  subjects 
(F(5,108)=29;  p<0.0001),  and  T  and  Crooked  T  approach  types  (F(l,108)=28.4;  p<0.0001).  The 
least  mean  square  workload  scores  by  display  type  were  estimated  as:  triangle/ same=3. 8; 
triangle/opposite=3.9;  track  vector=4.0,  HSI=3.9;  XTE  only=4.5.  However,  adding  display  to 
the  ANOVA  did  not  produce  a  significant  effect.  No  trends  were  found  by  sequential  approach 
or  session  number,  suggesting  training  had  asymptoted  practice  effects.  Ranking  workload 
scores  within  subjects  did  not  reveal  a  display  dependent  effect.  It  was  concluded  that  although 
the  workload  metric  was  demonstrably  sensitive  to  approach  geometry,  display  effects,  if  they 
exist,  must  be  small  compared  to  geometry  and  inter-subject  effects. 

The  pilots  ranked  the  approach  legs  in  order  of  decreasing  difficulty:  1)  long/dogleg  final,  2) 
short  final,  3)  intermediate  leg,  4)  first  miss,  5)  initial  leg,  and  6)  second  miss  leg.  Ranking  was 
identical  for  both  approach  geometries,  and  the  concordance  of  workload  rankings  within 
geometries  was  statistically  significant  (Friedman  ANOVA,  df=5;  p<0.0001). 


3.4  DISPLAY  EFFECTS  ON  GROUND  TRACK,  INTERCEPT,  AND  LEG  TRACKING 
PERFORMANCE  PARAMETERS 

The  reoriented  aircraft  ground  tracks  are  shown  superimposed  in  Figure  6,  staggered  by  the  five 
display  types.  The  Crooked  T  tracks  can  be  distinguished  by  the  dogleg  after  the  FAF.  Several 
approaches  where  pilots  made  gross  errors  are  apparent,  particularly  for  the  XTE-only  display 
(upper  right).  The  frequency  of  such  errors  was  noted  to  be  less  with  the  HSI  and  triangle/same 
displays  (left  and  third  from  left). 
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Figure  6.  Reoriented  Ground  Track  Overlays  for  T  and  "Crooked  T"  Approaches, 

by  Display  Type 


When  the  simulation  began,  with  the  aircraft  positioned  a  half  mile  upwind  of  the  lAF,  the  pilot’s 
first  task  was  to  intercept  the  initial  approach  leg.  Use  of  TAE  displays  resulted  in  different 
intercept  performance,  probably  because  pilots  were  less  aware  of  the  crosswind  component 
(always  from  the  right  in  Figure  6),  which  inherently  tended  to  blow  the  aircraft  toward  the 
desired  track,  and  some  failed  to  compensate  for  it.  Two  measures  of  intercept  performance  were 
assessed,  as  shown  in  Figure  7:  1)  “Intercept  Angle,”  the  absolute  value  of  TAE  when  XTE 
equaled  0.3  nm,  and  2)  “Intercept  Distance,”  the  distance  where  the  aircraft  first  crossed  within 
0.05  nm  of  the  initial  approach  centerline.  As  shown  in  Figures  8  and  9,  Intercept  Angle  and 
Intercept  Distance  were  consistently  steeper  and  shorter,  respectively,  for  approaches  made  with 
the  non-TAE  displays.  The  average  increase  in  intercept  angle  with  non-TAE  formats 
approximated  the  drift  angle  to  be  expected  (12  deg)  for  pilots  unaware  of  the  crosswind. 
ANOVA  of  intercept  angle  data  showed  significant  effects  by  display  (F(4,85)  =  24.1,  p 
<0.0001)  ,  subject  (F(5,85)-4.6,  p  <0.6oi),  and  subject  by  display  (F(20,85)»  1.7,  p  <0.04). 
Similarly,  an  intercept  distance  ANOVA  revealed  significant  effects  by  display  (F(4,85)  -  23.9, 
p  <0.0001),  subject  (F(5,85)  =  4.6,  p  <0.001)  and  subject  by  display  (F(20,85)  ■=  2.1,  p  <0.007). 
The  significant  subject  by  display  interaction  effects  indicate  that  some  subjects  used  the  TAE 
information  differently  than  others.  Contrasts  comparing  TAE  and  non-TAE  intercept  angle  and 
distance  results  by  display  were  both  significant  (p  <  0.0001). 


Figure  7.  Deflnitions  of  Intercept  Performance  Measures 
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Figure  8.  Intercept  Angle  (Degrees)  vs.  Display  Type 


Figure  9.  Intercept  Distance  from  MAHF  (nm)  vs.  Display  Type 

Once  established  on  the  initial  leg,  pilots  flying  with  the  triangle/same  and  vector  displays  had 
smaller  downwind  biases,  as  shown  in  Figure  10.  The  difference  in  average  tracking  bias  was 
significant  by  display  (F(4,90)  -  7.8,  p<.001)  and  subject.  (F(5,90)  =  6.4;  p  <.001).  The  subject 
by  display  interaction  was  not  significant. 
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Figure  10.  Average  XTE  (nm)  for  Miles  2-4  of  Initial  Approach  Leg  vs.  Display  Type 

Considering  the  XTE  and  TAE  data  from  the  tracking  portions  of  the  initial,  intermediate,  and 
second  missed  approach  legs  (i.e.,  combining  data  obtained  from  miles  23-21,  19-17,  and  4.5-1 
from  the  MAHF),  ANOVA  demonstrated  significant  effects  of  display  (F(4,329)  -  2.7,  p<0.03) 
and  subject  (F(5,329)  =14.8,  p<  0.0001)  for  the  standard  deviation  of  XTE  and  also  the’ standard 
deviation  of  TAE  (display:  F(4, 168)  =  4.9,  p<  0.001;  subject:  F(5, 168)=11,  p<  0.0001).  This 
vi^as  consistent  with  the  hypothesis  that  pilots  in  fact  were  controlling  TAE.  The  subject  by 
display  interaction  term  was  also  significant,  indicating  that  certain  subjects  made  better  use  of 
the  TAE  information  than  others.  The  HSI  or  triangle/same  displays  generally  ranked  best  in 
terms  of  performance,  followed  by  the  track  vector  display.  Average  display  effects  were  smaller 
than  subject  effects.  The  standard  deviation  of  XTE  was  consistently  lower  on  the  final  approach 
leg,  as  the  aircraft  approached  the  MAP. 

Inter-subject  differences  in  XTE  and  TAE  tracking  performance  correlated  with  inner  loop 
attitude  control  for  the  corresponding  segments.  Two  subjects  (2  and  6)  consistently  showed 
larger  values  of  standard  deviation  of  pitch  and  roll  attitude,  airspeed,  and  altitude,  suggesting 
that  their  effective  attitude  instrument  scanning  delay  was  longer.  There  was  no  clear  effect  of 
display  format  in  the  longitudinal  axis  on  pitch,  airspeed,  and  altitude,  but  for  the 
lateral/directional  axis,  ANOVA  revealed  a  significant  effect  of  both  subject  (F(5,449)-59, 
p<.0001)  and  display  (F(4,449)=3.9,  p<.004)  on  the  variation  in  roll  attitude.  No  correlation  of 
segment  performance  with  pilot  recent  or  total  experience  was  found,  except  for  pilot  2,  whose 
recent  instrument  time  was  only  in  helicopters. 
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3.5  DISPLAY  EFFECTS  ON  ESTIMATED  95%  LIMITS  OF  CROSS  TRACK  ERROR 


To  assess  the  effects  of  display  format  on  flight  technical  error,  the  estimated  95%  limits  of  the 
XTE  distribution  were  plotted''  for  the  T  approaches  (Figure  1 1 ),  the  Crooked  T  approaches 
(Figure  12)  and  all  approaches  combined  (Figure  13).  Each  of  the  three  figures  has  ten  panels, 
which  compare  the  width  of  the  XTE  envelopes  pairwise  by  display.  In  each  panel,  the  shaded 
regions  depict  the  95%  limits  (in  feet)  estimated  using  the  sample  variance  of  the  noimalized 
track  data  for  each  slice.  As  shown  in  the  key,  the  ordinate  is  distance  along  the  desired  track 
measured  from  the  MAHF.  Only  data  between  23  miles  (typical  initial  intercept)  through  10 
miles  (MAP)  are  shown.  Diamonds  on  the  ordinate  denote  waypoints,  as  indicated  in  the  key. 
Circles  and  crosses  denote  slices  where  an  F  ratio  test  comparing  the  XTE  sample  variance  for 
the  two  displays  showed  a  significant  difference.  Note  that  the  upper  confidence  limits  for  the 
XTE  variance  depend  on  the  number  of  approaches. 

The  analysis  of  the  XTE  slice  data  revealed  significant  differences  between  displays  during 
initial,  intermediate,  and  final  approach: 

a)  On  the  initial  approach  leg,  F  ratio  tests  showed  the  triangle/same  display  XTE  envelope  was 
significantly  narrower  than  all  other  displays  (c.f.  Figure  13b,  e,  g,  and  i).  Also,  the  centers  of 
the  initial  approach  envelopes  for  the  HSI  and  XTE  only  formats  were  clearly  displaced 
downwind,  as  indicated  by  negative  envelope  mid  values  in  Figures  13d  for  23-21  miles,  as 
compared  to  all  three  TAE  based  displays  (Figures  13a-c,  h,  i,  and  j).  The  latter  finding  reflects 
the  significant  difference  in  tracking  bias  effect  described  earlier  (Figure  10). 

b)  During  and  immediately  after  the  90  deg  turn  at  the  IF,  pilots  using  the  HSI  had  significantly 
narrower  XTE  envelopes  than  with  any  of  the  other  displays  (Figures  1 3a-d),  by  F  ratio  test.  As 
compared  to  the  other  displays,  the  track  vector  display  envelope  remained  relatively  wide 
between  the  IF  and  the  sensitivity  changeover  waypoint  (Figures  1 1  and  12c,  e,  f,  and  h). 
Thereafter,  however,  XTE  rapidly  converged. 

c)  On  T  geometry  final  approaches,  the  track  vector  display  envelope  was  narrower  than  for  any 
of  the  other  displays  (Figures  11  c,  e,  f,  and  h),  significantly  so  on  short  final,  one  mile  from  the 
MAP.  The  differences  between  displays  disappeared  at  the  MAP  itself,  perhaps  because  by  then 
the  pilots  had  shifted  their  attention  to  missed  approach  activities.  Average  95%  XTE  envelope 
width  during  the  last  three  miles  of  final  approach  provides  a  useful  metric  for  approach 
performance  comparisons.  Average  envelope  widths  were;  HSI:  0.17  nm,  triangle/opposite:  0.22 
nm,  triangle/same;  0.21  nm,  track  vector:  0.15  nm,  and  XTE  only:  0.23  nm.  Comparing  the  track 
vector  result  with  that  of  XTE  only,  deletion  of  TAE  vector  information  from  the  receiver  display 
resulted  in  a  53%  increase  in  the  average  envelope  width. 


‘  Two  approaches  with  large,  outlier  XTE  values  due  to  pilot  disorientation  were  omitted  from  the  analysis. 
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Figure  12. 95%  Limits  of  XTE  Distribution  for  “Crooked  T”  Approaches  Only  (cont.) 
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Figure  13. 95%  Limits  of  XTE  Distribution  for  “Crooked  T”  Approaches  Only  (cont.) 
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d)  On  the  Crooked  T  approaches,  the  XTE  envelopes  consistently  widened  out  after  the  first  and 
second  45  deg  turns.  However,  re-intercept  performance  and  short  final  tracking  was 
consistently  better  with  the  track  vector  display  (Figure  1 2  c,  e,  f,  and  h).  The  track  vector  was 
the  only  one  of  the  five  displays  for  which  the  CDI  was  predicted  to  remain  on  scale  through 
both  turns  in  95%  of  approaches  flown.  The  next  best  performance  was  with  the  triangle/same 
display  (Figure  12e).  The  relatively  poor  performance  with  XTE-only  and  HSI  displays  (Figures 
12c,  h,  and  Figures  12b,  12i)  after  45  deg  turns  using  high  CDI  sensitivity  suggests  clear 
advantages  for  track  vector  and  triangle/same  displays  when  circumstances  compel  pilots  to 
maneuver  during  the  critical  final  stages  of  an  instrument  approach. 

The  average  width  of  the  95%  XTE  envelope  on  the  last  3  miles  of  final  approach  with  the 
“XTE-only”  display  in  this  study  (0.24  nm),  was  qualitatively  similar  to  that  obtained  during  an 
in-flight  experiment  (0.32,  nm,  Huntley,  1993,  Table  6)  conducted  in  a  Beech  55  Baron,  also 
using  a  separate  XTE-only  CDI. 
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4.  CONCLUSIONS 


Results  showed  that  even  under  turbulence  conditions  requiring  diligent  attitude  instrument  scan, 
the  addition  of  analog  TAE  information  to  a  GPS  receiver  XTE  display  significantly  improved 
both  initial  and  final  approach  leg  intercept  and  tracking  performance,  probably  by  allowing  the 
pilot  to  predict  XTE  changes  and  create  outer  loop  control  lead.  Determination  of  wind 
correction  angle  was  greatly  simplified.  Given  the  choice  between  analog  and  numeric  TAE 
information,  pilots  elected  not  to  use  the  numeric  presentation.  Thus,  the  findings  support  the 
FAA  TSO-C129  airworthiness  criteria  recommendation  that  manufacturers  provide  analog  TAE 
display  capability. 

Certain  pilots  were  better  able  to  improve  their  performance  with  TAE  displays  than  others. 
However,  for  the  group  of  six  pilots,  the  “triangle/same”  TAE  display  —  a  sliding  TAE  pointer 
located  beneath  the  XTE  CDI  which  moved  in  the  same  direction  as  aircraft  bank  —  produced 
the  largest  initial  leg  intercept  and  tracking  performance  improvement,  and  was  preferred  overall 
by  the  pilots  for  flight  path  control.  An  integrated  XTE/TAE  “track  vector”  display  produced  the 
largest  reduction  (35%)  in  the  width  of  the  XTE  envelope  during  the  last  three  miles  of  final 
approach,  as  compared  to  control  tests  with  XTE-only  display.  The  track  vector  display  could 
be  visualized  as  a  track  up  moving  map,  but  pilots  occasionally  had  difficulty  maintaining  the 
map  interpretation,  particularly  immediately  after  waypoint  changeover  following  a  90  deg  turn. 
There  is  reason  to  think  performance  with  this  format  may  be  improved  by  making  it  appear 
more  map-like.  Control  testing  with  a  horizontal  situation  indicator  which  displayed  heading  and 
XTE  (but  not  TAE)  in  the  center  of  the  primary  instrument  panel  demonstrated  that  the 
performance  advantages  of  adding  TAE  to  the  receiver  display  was  partly  offset  by  the  resulting 
widening  of  the  pilot’s  instrument  scan.  This  problem  can  likely  be  mitigated  by  simultaneously 
displaying  XTE  on  the  HSI  and  XTE/TAE  information  on  the  GPS  receiver,  but  this  has  not  yet 
been  demonstrated. 

Although  Bedford  workload  scores  were  sensitive  to  approach  geometry,  no  consistent  effect  of 
display  format  on  workload  was  found.  It  is  possible  that  our  pilots  adjusted  their  own 
performance  criteria  so  that  workload  remained  approximately  constant,  and  performance  varied 
instead. 
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APPENDIX  A-l:  FLIGHT  SIMULATOR,  COMPUTER  NETWORK,  TURBULENCE, 

AND  WIND  MODELS 


Volpe  FRASCA  242  Research  Flight  Simulator  and  Computer  Network: 

The  simulator  used  for  this  study  was  a  modified  Frasca  Model  242  convertible  flight  training 
device.  The  fixed  base,  two-seat  enclosed  cockpit  is  equipped  with  dual  yoke  and  rudder  pedals, 
and  an  instrument  panel  shown  schematically  in  Figure  Al-1.  Control  loading  varied 
dynamically  with  airspeed.  A  Horizontal  Situation  Indicator  (HSI)  was  located  immediately 
beneath  the  Attitude  Indicator.  Pilots  were  free  to  use  the  HSI  course  needle  and  heading  bug  as 
memory  aids,  at  their  own  discretion.  GPS  displays  were  presented  on  a  10-inch  diagonal  color 
active  matrix  LCD  Flat  Panel  Display  installed  to  the  right  of  the  primary  instrument  panel.  The 
aircraft  was  equipped  with  simulated  dual  720  channel  navcomm  radios,  headsets,  and  intercom. 
Simulated  VOR/ILS/ADF  avionics  and  an  autopilot  with  flight  director  were  also  available,  but 
not  utilized  in  the  present  experiment. 

The  Frasca  242  simulator  uses  a  Zendex  80386-based  digital  Simulation  Computer  running  flight 
system  software  (Frasca  X4X  EPROM  version  1.11),  which  models  the  flight  dynamics  of  the 
aircraft,  determines  its  position,  and  drives  the  conventional  cockpit  instruments,  avionics,  yoke, 
and  autopilot.  Aircraft  flight  characteristics  are  determined  by  aerodynamic  model  performance 
constants  which  can  be  changed  via  the  operator  console.  The  set  of  model  constants  used  had 
been  developed  by  the  manufacturer  to  resemble  the  performance  of  a  Piper  Aztec. 

As  shown  in  Figure  A 1-2,  seven  additional  80386  computers  were  used  to  extend  the  capability 
of  the  simulator.  These  computers  ran  program  modules  written  in  Visual  Basic,  and  communi¬ 
cated  with  one  another  and  to  the  Volpe  Center  computer  network  and  file  servers  via  a  local  area 
network  (Ethemet/Windows  for  Workgroups/Novell  Netware).  The  seven  computers  are  desig¬ 
nated  by  the  function  of  their  resident  software  modules. 

The  Simulation  Control  Console  (“runcon”)  module  permitted  the  user  to  select  an  approach 
geometry,  to  monitor  the  status  of  the  other  computers,  and  to  provide  a  data  recording  facility. 

It  also  allowed  various  flight  variables  to  be  monitored  during  a  simulation.  All  the  data  distrib¬ 
uted  around  the  system  was  collected  and  stored  in  memory  for  later  storage  in  the  network  data 
archive.  The  position  of  the  aircraft  was  also  plotted  on  a  user  display  for  monitoring  purposes. 

The  data  server  provided  the  link  to  the  Frasca  simulation  computer.  It  is  used  to  initialize  the 
simulation  computer  prior  to  each  approach,  read  the  various  state  variables  from  the  simulator 
and  distribute  them  to  the  other  computers  via  Windows  Dynamic  Data  Exchange  (DDE)  links 
during  each  approach. 

The  GPS  simulator  monitored  the  simulated  latitude/longitude  position  read  by  the  data  server, 
and  calculated  ground  speed,  cross  track  error  and  track  angle  error  based  on  flight  plan  par¬ 
ameters.  The  waypoints  of  the  flight  plan  are  stored  on  a  common  Microsoft  Access  Database 
and  the  Control  Console  told  the  GPS  simulator  program  which  plan  to  use.  The  GPS  data  cal¬ 
culated  were  distributed  via  Network  DDE  links  read  by  the  Control  Console,  the  Flat  Panel 
Display  Controller  and  the  Instrument  Server. 
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Figure  Al-1.  FRASCA  242  Research  Flight  Simulator:  Cockpit  Layout 
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The  Wind  Simulator  continuously  updated  the  local  wind  speed  and  direction  used  by  the  Frasca 
computer  based  on  aircraft  altitude,  using  a  model  described  below. 

The  Flat  Panel  Display  Controller  drove  the  Flat  Panel  Display  used  to  show  the  GPS  receiver 
displays  employed  in  the  present  experiment. 

The  Instrument  Server  and  Instrument  Controller  computers  commanded  certain  other  analog 
instruments  and  displays,  including  the  CDI  needle  located  on  the  HSI  instrument.  The 
Instrument  Server  program  received  digital  CDI  needle  commands  via  Network  DDE  links  and 
sent  them  via  a  Serial  RS232  link  to  the  Instrument  Controller,  which  in  turn  drove  the  CDI  via  a 
D/A  converter. 

Wind  Model 


The  atmospheric  wind  model  interpolated  values  for  wind  upward  from  the  surface  through  a 
given  value  at  a  reference  height  (“atmospheric  boundary  layer  thickness”),  assuming  that  wind 
speed  increases  exponentially  with  height  above  ground  (Etkin,  1980),  and  that  the  near-ground 
exponent  depends  on  ground  roughness. 


The  model  used  assumed  that  if 

h  =  aircraft  altitude  above  ground  level  (ft) 

U  -  wind  velocity  at  altitude  h  (ft/sec) 

5  =  atmospheric  boundary  layer  thickness  (assumed  to  be  3000  ft  in  this  simulation) 

Ug  =  wind  at  h  =  8 

R  =  ground  roughness  height  (assumed  to  be  20  ft  for  this  simulation) 

Uo=  wind  at  ground  level  (ft/sec) 

U  =  Uo  +  (U8-Uo)(h/8)« 

if  0  ^  h  ^5,  then  a  =  0.0072R  +  0.14 
if  h  >  8 ,  then  a  =  0.35 

Non-Gaussian  Atmospheric  Turbulence  Model: 

Patchy  turbulence  was  created  by  adding  disturbance  signals  to  the  Frasca  simulator’s  roll  and 
pitch  angles,  and  rate  of  change  of  heading  at  30  Hz.  Separate  turbulence  generator  models  were 
used  on  each  of  the  three  axes,  coded  in  the  simulator  EPROM  for  us  by  Frasca  International. 

The  model  employed  is  based  on  the  NLR  method  (Jansen,  1981;  Van  de  Moesdijk,  1978),  and  is 
documented  below: 

The  turbulence  disturbance  signal  d(t)  on  a  given  axis  is  the  product  of  an  axis  gain  factor,  K,  and 
a  unity  variance  signal  w(t).  The  power  spectrum  of  w(t)  is  determined  by  a  characteristic  time 
constant  t  ,  equal  to  the  ratio  of  turbulence  scale  length  to  airspeed,  L/V.  The  user  sets  a 
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“patchiness  intensity  factor”  Q,  which  determines  the  degree  to  which  the  signal  w(t)  departs 
from  a  Gaussian  distributed  signal  (Q=0)  toward  a  Bessel  distributed  signal  (Q=oo).  Thus, 
characteristic  patch  length  =  L/R,  and  characteristic  patch  duration  is  L/VR. 


Figure  A 1-3.  Turbulence  Synthesis  Method 


To  derive  w(t),  a  Gaussian,  band-limited,  unity  variance  random  signal  a(t)  was  created  by  using 
a  unity  variance,  Gaussian  distributed  random  number  generation  (RNG)  routine  to  derive  a  30 
Hz  white  noise  signal.  As  shown  in  Figure  A 1-3,  this  was  then  filtered  by  a  first  order  low  pass 
shaping  filter  Ha(s),  whose  gain  was  chosen  so  the  resulting  signal,  a(t),  had  unity  variance.  The 
result,  a(t),  was  multiplied  by  a  second  Gaussian  process  b(t),  formed  in  a  similar  way  with  a 
second  RNG  and  shaping  filter.  b(t)  had  a  lower  band-width,  determined  by  a  “patch  length 
factor,”  R,  which  varied  from  1  to  0.  The  product  a(t)«b(t)  was  a  unity  variance,  Bessel 
distributed  random  process.  Separately,  a  third  RNG  and  shaping  filter  was  used  to  create  a 
“baseline”  Gaussian  process  c(t).  The  two  signals  a(t)*b(t)  and  c(t)  were  blended  together  using 
functions  of  a  “patchiness  intensity”  parameter  Q  so  that  the  variance  of  the  resulting  sum,  w(t), 
had  a  unity  variance  independent  of  Q.  The  value  of  R  did  not  affect  the  power  spectrum  or  the 
probability  density  function  of  w(t). 

So: 

w(t)  =  a(t)-b(t)  c(t)-7=i= 

ve'+i  4q^+i 

where  a(t)  is  a  Gaussian  output  of  filter  Ha,  b(t)  is  the  patchiness  modulator  output  of  filter  Hb, 
and  c(t)  is  the  purely  Gaussian  output  of  filter  He- 

Filter  transfer  functions  H  a,b,c  are: 

Where: 

r,  =  r(R  +  l)/R 
T,=T  =  LfV 
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and 


The  turbulence  magnitude  on  each  axis  was  set  by  a  turbulence  gain  parameter.  Band-width  and 
statistical  characteristics  on  each  axis  were  adjusted  using  three  other  parameters.  For  purposes 
of  our  simulation,  the  roll  turbulence  scale  L  was  set  at  500  ft,  and  the  characteristic  patch  length 
at  2500  ft,  so  the  characteristic  roll  axis  patch  duration  was  12.5  seconds.  The  pitch  turbulence 
scale  was  200  ft.  Since  the  patch  length  was  4-10  times  shorter  than  any  of  the  approach 
segments  evaluated,  RMS  turbulence  parameters  were  essentially  constant  across  approaches. 

The  ratio  of  roll/pitch/yaw  RMS  disturbance  was  15/5/1  times,  respectively.  The  effect  of  adding 
patchiness  to  the  roll  disturbance  is  illustrated  in  Figure  A 1-4  below  (Top:  Q=5;  Bottom,  Q=0). 


1 

0 

-1 

0  50  100  150  200  250  300 


Non-Gaussian  turbulence  velocity  dwQVdt  with  patchiness 
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Figure  Al-4.  Example  of  Turbulence  Disturbance  Signals 
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APPENDIX  A2  -  APPROACH  CHARTS 


Figures  A2-1  through  8:  The  eight  simulated  GPS  non-precision  approach  charts  to  fictitious 
airports  used  in  the  experiment: 

“T”  Approaches: 

Figure  A2-1 :  Bathurst  (BTA)  Runway  24 
Figure  A2-2:  Coffs  Harbour  (CFB)  Runway  6 
Figure  A2-3:  Condobolin  (CDN)  Runway  34 
Figure  A2-4:  Tamworth  (TMA)  Runway  16 

“Crooked  T”  Approaches: 

Figure  A2-5:  Cadney  Park  (CPA)  Runway  28 
Figure  A2-6:  Dalhousie  Springs  (DHS)  Runway  10 
Figure  A2-7:  Mudgee  (MDG)  Runway  13 
Figure  A2-8:  Wamambool  (WMB)  Runway  31 


37 


FIGURE  A2-1.  BATHURST  (BTA)  RUNWAY  24 
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FIGURE  A2-2.  COFFS  HARBOUR  (CFB)  RUNWAY  6 
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FIGURE  A2-3.  CONDOBOLIN  (CDN)  RUNWAY  34 
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FIGURE  A2-4.  TAMWORTH  (TMA)  RUNWAY  16 
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FIGURE  A2-5.  CADNEY  PARK  (CPA)  RUNWAY  28 
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FIGURE  A2-6.  DALHOUSIE  SPRINGS  (DHS)  RUNWAY  10 
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FIGURE  A2-7.  MUDGEE  (MDG)  RUNWAY  13 
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HGURE  A2-8.  WARNAMBOOL  (WMB)  RUNWAY  31 
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(Satisfactory:) 
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